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Executive Summary 

Children and youth require safe and supportive schools and communities if they are to succeed in 
school and thrive. These needs are particularly great for children who struggle with the impacts 
of chronic poverty, lead poisoning and lead effect, community and media violence, dmgs and 
alcohol, trauma and loss. There are many such students in Cleveland, and our research suggests 
that many of them attend schools that do not sufficiently address their needs. 

The Cleveland Metropolitan School District (the District) and the mayor of Cleveland asked the 
American Institutes for Research (AIR) to conduct an independent gaps analysis and to make 
recommendations regarding what can be done in Cleveland’s schools and by its mental health 
and other community agencies to improve the connectedness that students have to school, as well 
as their mental wellness and safety. AIR was asked to focus primarily on the District’s schools, 
but to also examine and make recommendations regarding what is being done and what could be 
done in the community to improve connectedness and enhance mental wellness and safety. At 
AIR’s request, and with the permission of the mayor, the District’s chief executive officer (CEO) 
and Cuyahoga County leadership, AIR extended this analysis to relevant county activities. 

Activities Conducted as Part of the Gaps Analysis 

During a six-month period, AIR carried out a number of activities: 

• Spoke with more than 100 individuals about what was working and sufficient, what was 
working but insufficient, what was working but needed refinement, what was missing, 
what was not working and what was having harmful impacts. We also spoke with 
individuals responsible for the District’s human ware efforts. These individuals included 
the mayor and members of his cabinet, the District’s chief executive officer and members 
of his leadership team (e.g., chief operations officer, chief academic officer, assistant 
superintendents), the chief of police, the director of health, the director of public safety, 
the city council, the Board of Education and the leadership of the Cleveland Teachers 
Union (CTU). We also met with the leaders and key staff from county and non-profit 
agencies that fund, plan, assess and provide health, mental health, youth development, 
juvenile justice and child welfare services; family members; children and youth; 
members of the faith community; community activists who are concerned with youth 
development and violence prevention; and state education and mental health officials. 

• Surveyed District students in grade 5 and up regarding the extent to which they feel 
emotionally and physically safe, supported, connected and challenged - and in an 
environment where their peers are socially responsible. 

• Conducted two-day site visits to four Cleveland schools, which were selected randomly 
using a process that maximized their representativeness and ensured that they included 
one elementary and one high school from both the east and the west sides of Cleveland. 
During each site visit, AIR staff conducted focus groups with students, faculty and 
families who were selected randomly; made classroom observations in randomly selected 
classes; observed public spaces as well as special facilities; and interviewed individuals 
with particular expertise, such as principals, assistant principals, pupil service personnel, 
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security staff, lunchroom staff, union leadership and other teachers and staff who were 
identified because of their special knowledge or expertise. 

• Conducted a site visit to SuccessTech Academy, where AIR met with students, faculty 
and families who were selected randomly; made classroom observations in randomly 
selected classes; observed public spaces as well as special facilities; and interviewed 
individuals with particular knowledge and expertise. 

• Analyzed data from the Conditions for Learning Safety and Youth Risk Behavior Survey 
and data sets regarding attendance, teacher characteristics, crime in the community, 
economics of the community, mobility between schools and districts, graduation test 
results, annual yearly progress standing and other school characteristics such as race, 
special education, limited English proficiency and student disabilities. 

• Reviewed reports and documents that recommended improvements in agency and school 
collaboration and organization. 

• Reviewed memoranda of agreement, contracts, manuals and publications that address 
human ware-related activities. 

• Analyzed evaluations and research relevant to District and agency initiatives and, where 
possible, interviewed the evaluators and researchers. 

• Conducted feedback sessions with key stakeholders to deepen AIR’s understanding of the 
readiness for change and the issues that must be taken into account in implementing 
sustainable change. Participants included the mayor and the CEO and members of the 
leadership team, representatives of the funding community and CTU, county leaders, 
evaluators, and the leaders and key staff from mental health and youth development 
agencies. 



Findings and Recommendations 

Framework for Understanding AIR’s Findings and Recommendations 

AIR’s findings and recommendations employ a three-tiered public health approach (Figure A) 
for collecting and using data on all children, youth, neighborhoods and schools to identify needs 
(including factors that place individuals at risk) and assets (including factors that buffer or 
moderate risk factors), parse or triage resources, plan interventions and monitor results. The 
three-tiered approach is consistent with seminal documents in violence prevention, mental health 
promotion and prevention and student support (Dwyer & Osher, 2007; Dwyer, Osher, & Warger, 
1999; Ohio Department of Education, 2008b; Osher, Dwyer, & Jackson, 2004; U.S. Department 
of Education, 1994; U.S. Public Health Service, 1999, 2000a, 2000b). The three tiers follow. 

• Universal promotion and prevention for everybody or all members of a group (e.g., all 
students, all teachers) at a school, district or community level. Universal promotion 
focuses on enhancing individual and environmental strengths and assets to reduce the risk 
of later problems and to increase the opportunities for healthy development and thriving. 
Universal prevention addresses individual and environmental risk factors that could place 
individuals at risk of poor outcomes. 
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• Early intervention for individuals who are at a known (by membership in a subgroup) or 
identified (by screening or other data collection) level of risk. 

• Providing intensive interventions and treatment for individuals who are determined to 
be at higher levels of risk or need. 

Figure A. A Three-Level Approach to Preventing School Violence 




Adapted from Dwyer & Osher, 2000 



Provide Intensive Interventions 

Provide coordinated, comprehensive, intensive, 
sustained, culturally appropriate, child- and family- 
focused services and supports. 

Intervene Early 

Create services and supports that address risk 
factors and build upon protective factors for 
students at risk for severe academic or 
behavioral difficulties. 

Build a Schoolwide Foundation 

Support positive discipline, academic success and 
mental and emotional wellness through a caring 
school environment teaching appropriate behaviors 
and problem-solving skills, positive behavioral 
support, social and emotional learning and 
appropriate academic instruction. 



The framework uses this three-tiered approach for assessing and improving conditions and 
capacities that support learning, teaching, safety and child and youth development. Conditions 
are those environmental features that facilitate or serve as barriers to learning, teaching and 
development. Conditions include the culture of schools and agencies as well as the extent to 
which students and teachers are, and feel that they are, safe, connected and supported, engaged 
and challenged, and in environments where children, youth and adults can manage their 
emotions and relationships productively. 

Individual capacities involve personal characteristics, attitudes and skills that help children and 
youth leam and develop and help teachers succeed as educators. The stronger their capacities 
are, the more likely it is that the learner or the teacher can withstand challenges and poor 
conditions. However, very poor conditions usually overwhelm strong capacities and, even when 
they do not overwhelm them, will limit effectiveness. Becoming a premier school district and a 
city where all children thrive depends on strong conditions and capacities. 

School, district and agency capacities consist of factors that enable these organizations to 
succeed in supporting learning, teaching and development. Organizational capacities consist of 
policies, frameworks, protocols, the portfolio of interventions, the availability of individuals to 
implement and support the effective implementation of interventions, the quality of leadership, 
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financial and human resources, data systems, social capital and systems for monitoring and 
addressing challenges. 

District and Community Strengths and Assets to Build On 

Although Cleveland children face many challenges, AIR identified numerous strengths and 
assets that can be built on: 

A common understanding of many of the key issues between and among the 
mayor and his key leadership; the CEO and his key leadership; the Board of 
Education; the Cleveland Teachers Union; county health, human services, child 
welfare and juvenile justice leadership; and the families and community members 
interviewed 

Moving forward requires common goals and a common understanding of the challenges. The 
stakeholders whom we interviewed understand the depth of the problems that place children and 
youth at risk, want to do something about it and express a willingness to collaborate to make it 
happen. Many of the participating school and agency leaders are interested in data-driven and 
systemic approaches. They also support collaboration and are frustrated by limits to current 
collaborations. 

District leadership that is strategic and understands the relationship between safe 
and supportive schools and academically successful schools 

Leadership is essential to transforming schools. The CEO conceptualized “human ware,” and he 
and his chief academic officer understand the relationship between improved CFL and improved 
academic outcomes. The CEO and his direct supports are strategic, data driven and committed 
to working together. They work with a mayor and a chief of education who share a 
complementary vision and with a Board of Education that works together and understands the 
importance of human ware. 

Some very committed teachers, administrators and school staff 

Change requires initial adopters and leaders who demonstrate by “walking the walk.” During 
our site visits, we met with some teachers and administrators who model vision and commitment. 
These teachers contribute to the types of environments described in Cleveland Schools That Are 
Making a Difference. One example is a grade 5 teacher at a site visit school who gave her cell 
phone number to all 27 of her students and their parents and told them that she expects them to 
call when they have questions or needs. Another example is a high school principal at a site visit 
high school who (according to many of her teachers and administrators) tells her teachers to keep 
a picture on their desk and asks them daily if they are treating their students in the manner that 
they would want their own children to be treated. Then, there were the perspectives of students 
themselves, who in some school focus groups identified a particular person(s) in their school 
whom they trusted, knew cared and regularly went to for support or guidance. 
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A history of sustained collaboration in the community, which is currently realized 
in the Cuyahoga Tapestry System of Care and in Child Welfare Wraparound 
Initiatives 

Collaboration, which is necessary to improving outcomes for children with emotional and 
behavioral problems, will more likely occur when there are a set of positive experiences with 
collaboration to build on. Cleveland and Cuyahoga County public and private agencies have had 
this experience and have built on it. For example, Cuyahoga Tapestry System of Care’s roots 
trace to a Robert Wood Johnson mental health grant in the 1980s to the Positive Education 
Program and the Safe Schools Healthy Students grant at the beginning of the millennium. 
Similarly, the child welfare system of care has roots in neighborhood settlement houses, an 
Annie E. Casey Foundation initiative that was neighborhood focused. 

A history of community-school partnerships among the Cuyahoga County 
Community Mental Health Board, the Drug and Alcohol Board, the county Office of 
Child Welfare, the county Office of Probation, the Cleveland Municipal Police 
Department and the schools 

These partnerships, which sometimes include memoranda of agreement, bring mental health 
social workers into all Cleveland schools to address mental health needs. They also bring child 
welfare and probation workers into some schools to improve attendance, parent outreach and 
access to services, as well as facilitate the sharing of information between the police and the 
schools. 

Experience of successful mental health-school collaboration in some schools and 
an understanding of the conditions that lead to success 

The Cuyahoga County Community Mental Health Board and mental health agencies identified 
schools where there were successful collaborations. Principals validated these reports and 
pointed to improvements in grades and behaviors. Agency staff attributed the success to 
receptiveness of staff to programs, strong collaboration with staff, strong referrals from 
administrators and follow-ups between teachers and administrators. 

School structures, common frameworks and working relationships that can be 
built on 

The District has Building Leadership Teams that can become the foundation for Human Ware 
(HW) Teams; IBA Teams that can become the foundation for Student Support (SS) Teams; and 
Student Safety Teams (elementary schools), Student Leadership Teams (high schools), and 
Student-Parent Organizations that can provide the foundation for student and family engagement. 
The District also has had a successful Comprehensive School Health Plan Initiative with a 
coordinating committee that links District and agency staff, and a successful Comprehensive Sex 
Education Curriculum that can be a model for other curricula. 
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The location of responsibility for student support in the office of the chief 
academic officer 

Student support is usually separated from academic improvement and marginalized because it is 
not seen as being part of the core mission of schools. Cleveland has addressed this 
marginalization by having the chief academic office lead this work. That individual 
demonstrates a deep understanding of the relationship among the conditions for learning, student 
support and academic improvement. 

Strong foundations 

Cleveland foundations are relatively rich in resources and responsible in how they disburse their 
resources. They collaborate and understand the role that schools can play in youth development 
and have indicated that they are open to thinking about how they can make their investments 
more efficient. 

Strong university partners who have done good work evaluating programs and 
collecting and analyzing relevant data 

Faculty at local universities are well known for their expertise regarding poverty and violence 
prevention. They have produced high-quality evaluations of local initiatives and have developed 
innovative and actionable data bases that can be drawn on for planning, monitoring and 
evaluation. 

Some success at improving early intervention for children and toddlers 

Cleveland and Cuyahoga Country have invested in early childhood interventions that may reduce 
the incidence of children arriving at school unready to leam and unable to behave. The Positive 
Education Program’s Early Intervention Centers have, for many years, demonstrated the power 
of early intervention in decreasing poor school and behavioral outcomes. For the last 8 years 
Cuyahoga County has established an effective communitywide network of services for young 
children and their families. Cleveland’s Moms First Program offers prenatal home visits, which 
can provide information, linkages to service and care coordination. Invest in Children does 
innovative work in providing a single home visit to all first-time parents up to age 25 where it 
can identify medical concerns. Help Me Grow of Cuyahoga County provides home visiting to 
families of infants or toddlers who display at least 4 of 20 risk factors. This strategy has been 
demonstrated to prevent a host of negative outcomes. Although the Cuyahoga County version 
does not reach all intended parents, and loses some after they have entered the program, it 
provides another base to build on. 

Some experience in implementing evidence-based practices and effective 
strategies in some schools and agencies such as Peacebuiders, PATHS, FAST, 
Multisystemic Therapy and effective wraparound planning 

Cleveland has had experience implementing a variety of evidence-based programs. This 
experience can provide information about these programs and what is necessary if these or other 
evidence-based programs are to be implemented successfully. 
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Decisions that have been made to improve data systems for the District and the 
system of care 

Reliable data and information are key to assessment, planning, monitoring and evaluation. The 
District is implementing a new data system, which should make it easier to accomplish these 
functions. In addition, the Cuyahoga Tapestry System of Care has invested in a highly regarded 
management information system that has contributed to the stellar outcomes realized by 
Milwaukee’s Wraparound Milwaukee. 

Key Findings from the Gaps Analysis 

AIR’s gaps analysis identified many needs, which can be organized into three key findings: 

• Eight factors place children and schools at risk for poor school outcomes, emotional and 
behavioral problems and disorders, violence and an absence of effective interventions to 
address these risk factors. 

• Poor or weak conditions for learning exist in many Cleveland schools, along with an 
absence of effective approaches to improve these conditions. 

• Inadequate capacity to address the factors that place children and schools at risk of poor 
outcomes and to improve the conditions for learning, teaching and development are 
undeveloped and inconsistent. 

Key Finding 1: Factors That Place Children and Schools At Risk for Poor School 
Outcomes, Emotional and Behavioral Problems and Disorders and Violence 

We identified eight factors that place students and (or) schools at risk for poor outcomes, each of 
which can be addressed: 

1 . Chronic poverty and its impact on children. Family poverty places children at risk for 
poor behavioral and academic outcomes. Cleveland’s poverty rate for young children 
was 20.1 in 2004 (Coulton, Hardy, & Lalich, 2006). Neighborhood poverty contributes 
to poor outcomes once children are in school. The level of poverty is so great in 
Cleveland that all students are eligible for free or reduced-price lunch. 

2. Lead poisoning and lead effect. Excessive lead exposure places children at risk for 
academic problems and anti- social behavior. Compared with other cities, Cleveland had 
the highest rate of children with lead poisoning in 2003. The percentages were 2% 
nationally, 6% in Cuyahoga County and 17% in Cleveland (Center for Health Affairs, 
2007). 

3. Harsh and inconsistent approaches to discipline. Numerous informants stated that 
many Cleveland families (like families in other parts of the country) employ disciplinary 
practices that have been demonstrated to contribute not only to problem behavior in 
school but also to antisocial behavior. These practices include harsh punishment and 
inconsistent approaches to discipline (Patterson, Reid, & Dishion, 1992; Strauss, 1991). 
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4. Reactive and punitive approaches to school discipline. Reactive and punitive 
approaches to school discipline have been demonstrated to exacerbate discipline 
problems, contribute to drop out and reduce the level of connectedness that students 
experience at school (Mayer, 2001; Mayer & Sulzer-Azaroff, 1991). We observed some 
school staff responding to students in a reactive and punitive manner, which was not 
always developmentally appropriate. For example, in one school we observed an 
administrator publicly chastising a male student for having to use the restroom several 
times during a single class. In addition, a large majority of randomly selected secondary 
school students who participated in the case study and validation focus groups reported 
that they had been removed from class (e.g., in-school suspension) at least once. 

We found an absence of positive behavioral supports and approaches. Teachers and 
administrators are not appropriately trained on how to deal with disruptive students, and 
some school staff in both the high schools and the elementary schools do not model 
positive behavior. Although we saw some visual reminders of good behavior, they are 
mass-produced and not individualized for the schools. School suspension is used 
ineffectively in three of the four case study schools. Administrators and teachers in all 
case study schools and validation focus groups reported that particularly troublesome 
students are suspended and “shipped between schools” without providing them (or the 
receiving school) with additional supports to address the problem behavior. 

5. Unclear and inconsistently implemented disciplinary codes. In site visit schools, 
disciplinary codes are not adequate or are unclearly stated. Even when discipline 
procedures are clearly stated, they are not implemented or are implemented inconsistently 
across students. Positive approaches to discipline were not evident in school procedures 
where we saw and heard about the frequent use of detention, suspension and expulsion as 
punishments. The 2007-08 CMSD Code of Conduct is generally written with a negative 
tone. Many sections of the document read like a criminal code without a clear 
explanation of why the procedure is important to school safety and discipline. 
Consequently, even routine or age-specific discipline issues (e.g., acting out or 
oppositional behaviors) are treated as “criminal” behaviors. Although the code suggests 
that problem solving should be used in the disciplinary process, there is almost no 
mention of how a student or family might access this support. 

6. Poor adult supervision and role modeling in schools. Although we met and observed 
many talented teachers, administrators and support staff, the research team observed (and 
focus groups validated that) some teachers, administrators and security officers who did 
not always model social and emotional skills in their interactions with students. 

Examples included security officers either being overly aggressive and harsh with 
students and officers becoming too friendly with students and contributing to problematic 
behaviors. 

7. Limited family-school connection. Collaboration between families and schools has been 
demonstrated as key to academic success and mental health observations. Some of our 
site visits identified disconnects between families and schools, which we confirmed by 
discussions with some families and school staff. 
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8. Schools where the mental health needs of students overrun the capacity of schools. 
When the mental health needs of students exceed the capacity of schools, the needs of 
these students can overwhelm a school. Such schools have been described as “truly 
disadvantaged schools” (Sebring, Allensworth, Bryk, Easton, & Luppescu, 2006). In 
these schools, the behavior of students with unaddressed mental health needs drives staff 
attention so that staff members experience the school as being out of control - the school 
focuses on fighting rather than on preventing “fires” and on punishment rather than on 
prevention. For example, almost all administrators at case study high schools reported 
that they spend over 80% of their time on discipline or “fighting fires.” Similarly, 
teacher attendance rates were lower in Cleveland (90.3%) than in other urban Ohio 
school districts during the 2006-07 school year, including Akron (94.8%), Cincinnati 
(95.0%), Columbus (94.9%) and Toledo (94.3%). 

Key Finding 2: Poor or Weak Conditions for Learning, Teaching and Development 
and a Lack of Effective Approaches to Build These Conditions for Learning 

Research suggests that there are four conditions for learning: safety, connection and support, 
challenge and engagement, and an environment in which most individuals can productively 
manage and control their emotions and relationships (Osher et al., 2007; Osher, Sidana, & Kelly, 
2008). These conditions appear to be equally important to teaching and to child and youth 
development. Research also suggests that these conditions are particularly important for students 
who struggle with poverty and other factors that place them at risk. For example, statistical 
analyses linking the Conditions for Fearning survey data with neighborhood data suggest that 
although neighborhood disadvantage predicts the 2006-07 School Performance Index score for 
K-8 and high schools, student perceptions of school safety explain the neighborhood 
disadvantage. 



Safety 

Almost half of District middle school students believe that the safety and respectfulness of their 
school climate are problematic. CFF survey data show that 46% of middle school students 
report that their school needs improvement on the safe and respectful school climate scale. The 
percentage of students reporting that their school needs improvement on this scale is lower, on 
average, at the high school level (21%), although more than 48% of responding high school 
students report that they worry about crime and violence in school, and almost 43% state that 
students are threatened or bullied at their high school. 

These findings are reinforced by analyses of Youth Risk Behavior survey data that show higher 
percentages of Cleveland students carrying weapons to school and not going to school because of 
safety concerns than students in other many other urban districts. Some teachers have similar 
feelings. For example, most validation focus group teachers raised concerns about the extent to 
which their schools are physically safe. At the high school level, one teacher talked about having 
five active gangs in her school and considered the school’s security inept and inadequate. 

According to our observations and faculty and parent reports, security staff may not be in the 
right place at the right time because of a lack of appropriate supervision, inefficient use of their 
time, off-task behavior, unwillingness to do something or contractual limits. 
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Some school processes contribute to rather than eliminate discipline and safety problems. For 
example, students at the two case study elementary schools had to loiter outside the buildings 
because the school had not opened by the time students arrived. At the case study high schools, 
large numbers of students were tardy for first-period classes in part because of metal detector 
procedures. Some of them stayed in the hall where they became part of 40 to 50 students 
roaming the halls, participating in an occasional fight and occupying the time of security staff. 
The 40-minute class periods led to more opportunities for students to be tardy during the day and 
also contributed to hall problems. 

Social emotional learning 

The CFL survey responses of 78% of high school students and 35% of middle school students 
suggest that their schools need improvement in the area of social emotional learning (SEL). This 
result was confirmed by interviews and focus groups with students and faculty, who stated that 
“acting tough,” responding aggressively to being “dissed” and not listening to or showing respect 
to teachers were normative mechanisms for staying safe. Interviews with staff indicated that 
many students have poor social and emotional skills. 

Although the case study site visit schools have a number of programs that dealt with SEL-related 
matters, such as life skills and character education classes and curricula, the programs are not 
evidence-based programs. Although a few District schools and mental health agencies employ 
or are considering some evidence-based programs (Peace Builders, PATHS), these schools are a 
minority and not part of a systematic effort aimed at improving student’s social and emotional 
learning. 



Connection and support 

Student support appears to be more problematic at the high school level. The survey responses 
of 30% of high school students and 21% of middle school students suggest that their schools 
need improvement in the area of student support. At the case study schools, although most 
students indicated that they have a least one caring adult in the school to whom they can turn to 
for support, most have five or six teachers about whom they did not feel the same way. Among 
students in the validation focus group, only one student indicated that most teachers in the school 
“will go the extra mile,” with other students citing percentages that varied from 10% to 50%. 
Interviews with teachers and staff suggest that this situation may involve disconnects between 
students of color and White teachers. 

The case study high schools we observed are large, serving 1,538 and 1,496 students (Ohio 
Department of Education, 2008a). One high school had been broken up into smaller academies, 
and administrators and some teachers reported that the reorganization had improved climate and 
connection significantly. However, the faculty had voted to remove the small academies because 
of discomfort with the New Visions small school model, which eliminated the faculty experience 
of school. During our visit, administrators suggested and some teachers indicated that if they 
were asked to vote again, they would vote differently. 



August 14, 2008 



16 



American Institutes for Research 




Cleveland Metropolitan School District Human Ware Audit 



Class size is generally large. The District has made an astute decision in reducing class size in 
the primary grades. Given fiscal contingencies, that decision has increased class size in the 
upper grades. Many teachers had concerns about the impact of class size. For example, one 
highly experienced and very committed grade 5 teacher described how the increase in class size 
from 20 to 27 students prevented her from having the level of contact with each student that 
would permit her to sufficiently personalize instruction. 

The case study schools tend to lack centeredness on the developmental needs of students. In 
addition, most counselors do not provide social, emotional and (or) behavioral supports to 
students. At one high school, the major responsibility of the counselors is to re-enroll students 
who have been automatically removed from the school because of lack of attendance. This 
leaves no time for actual counseling. At the other high school, counselors are overwhelmed with 
dealing with crisis management. 

Key Finding 3: Undeveloped and Inconsistent Capacity to Address the Factors 

That Place Children and Schools At Risk of Poor Outcomes and to Improve the 

Conditions for Learning, Teaching and Development 

Our findings regarding capacity involve gaps that exist at school, district and community levels. 
They involve insufficient capacity to respond to warning signs, risk factors and mental health 
needs; assess, plan, allocate resources, monitor performance and progress and improve quality; 
and collaborate, coordinate and share information in a timely manner. 

Limited capacity to respond to warning signs, risk factors and mental health 
needs 

• No system is in place to identify and respond to students exhibiting warning signs. 
Most teachers and other school staff who were interviewed or participated in focus 
groups lacked awareness of early warning signs. Although some displayed initiative 
and reported worrisome signs, such as a student who was cutting herself, this was not 
based on any protocol and the teacher did not receive any feedback on what was done 
to address the perceived mental health need. The current suspension protocol does 
not mandate any immediate risk assessment. 

• No system is in place to act on tardiness and attendance data. Chronic tardiness and 
chronic absenteeism (more than 15 days) are problematic. The percentage of 
elementary school students identified as chronically tardy averaged 24.3%; it was 
67.4% and 62.3% at two elementary schools and exceeded 35.0% in another 12 
schools. The percentage of high school students identified as chronically tardy 
averaged 41.4%. The highest rates were 84.5%, 73.7% and 70.7%, with another eight 
high schools exceeding 50.0%. 

The percentage of elementary school students identified as chronically absent 
averaged 40.6%, with the highest rates being 91.4%, 71.9% and 66.1%, and the rate 
exceeded 50.0% in another 1 1 elementary schools. The percentage of high school 
students identified as chronically absent averaged 54.4% in the District. The highest 
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rates were 98.4%, 96.1% and 75.6%, and the rate exceeded 70.0% in another four 
high schools. 

The District lacks “real time” monitoring of student attendance at student arrival 
times and during transitions between classrooms. At the case study high schools, 
attendance was not taken until third period, which can encourage students to be 
consistently late. The schools visited also lack technology to easily document student 
attendance, and this affects the timeliness of information shared with 
parents/caregivers. For example, a parent indicated that a long period of time passed 
before she was notified that her child was not attending school. 

• Cleveland has a growing community culture around implementing science and 
evidence-based practices. It also has had some successful experience with evidence- 
based mental health practices such as Multisytemic Therapy, PATHS and FAST and 
has support for using them from certified trainers such as those at the Center for 
Innovative Practices. However, little evidence shows that most schools or agency 
providers employ evidence-based practices or even know about resources such as the 
National Wraparound Initiative, which has compiled the best research and practice 
evidence regarding effective wraparound. In addition, we found no indication that the 
District, agencies or foundations have developed standards for identifying programs 
and practices or identified a set of evidence-based interventions whose 
implementation they will support with training, coaching and financial support. 

• The availability of mental health personnel is insufficient. School-employed 
personnel are insufficient in number and are uncoordinated and inefficient. During 
the 2005-06 school year, the District employed 85 school psychologists and one 
social worker. The ratio of students per school psychologist during that year was 692 
to 1, approximately 38% greater than the professional standard. We observed schools 
using these services as reactive resources providing triage for mental health problems 
and crisis intervention. School psychologists were limited to these crisis 
interventions and testing (e.g., re-evaluations for students identified as needing 
special education services). Although teachers in the validation focus group 
commented that every high school needs a guidance counselor, counselors are rarely 
engaged in counseling or addressing academic or behavioral issues of students. 
Counselors at the case study high schools reported that they spend their time re- 
enrolling students who were administratively removed form the rosters. Neither 
counselors nor school psychologists are identified as interventionists for behavioral 
discipline problems. Agency directors and clinicians stated that space is a problem; 
we found that one case study high school lacks personal counseling space for three 
staff members. 

• Schools also have access to external resources provided by Project Line, a 
collaboration among the Cuyahoga County Department of Children and Family 
Services, which places social services workers and their supervisors in District 
schools to do work related to abuse and neglect; the Cuyahoga County Mental Health 
Board’s School-Based Mental Health Program, which leverages Medicaid resources 
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to fund social workers in every Cleveland school; the Cuyahoga Tapestry System of 
Care, whose care coordinators work with some schools; and a collaboration between 
the District and County Probation, which places probation officers in some schools. 
Although these supplementary services are very important, the case study school 
visits and some expert informants and validation focus group participants suggest that 
social workers are not always in schools when they are needed and, because of their 
schedule and other work demands, do not always participate on schoolwide teams. 

• Our interviews, focus groups and observations suggest that most teachers and other 
staff and administrators have had limited or insufficient training in positive 
behavioral approaches, the management of anti-social behavior, child development, 
adult development, social and emotional learning, early warning signs and working 
with culturally and linguistically diverse students (including those who are lesbian, 
gay, bisexual, or transgender) and families. 

Insufficient capacity to parse, triage and focus human ware resources 

We discovered little evidence of any systematic approach in allocating human ware resources to 
schools. Although some structures are in place, they are not sufficient to help schools, the 
District and community partners address the needs of students efficiently and effectively. For 
example, although there are mandated Building Leadership Teams, we did not find evidence that 
these or other principal-directed, schoolwide teams meet regularly to evaluate behavioral and 
instructional practices. Similarly, the major intervention process, the IBA Team, does not work 
consistently in an efficient manner. Its functioning appears to depend on the leadership of the 
principal and the IBA leader (i.e., whether it is viewed only as a special education intervention 
and whether mental health staff are available to participate on the team). There is also a lack of 
HW teaming at the District level where, for example, the supervisors of counselors are 
administratively separated from other pupil service personnel. 

Variable quality of school and community services and insufficient attention to 
monitoring quality on a child-by-child basis 

Expert informants suggested that quality varies among school- and agency-employed pupils 
service personnel, as well as among other social workers, care coordinators, agencies and 
Community Collaboratives. Sufficient attention to monitoring the quality and impact of these 
school and community services is also lacking. These observations appear to be consistent with 
extant evaluation data. For example, less than 50% of faculty polled responded to a 2006-07 
Beech Brook evaluation of agency-provided school-based mental health services, and of these, 
only 46.3% either strongly agreed or agreed that the academic status of students referred for 
services was improving. The percentage was 57.3% regarding behavior improvements of 
referred students (Noveske, 2007). However, almost all teachers who completed a survey agreed 
that providers were polite and friendly, 87% were satisfied with provider communication and 
almost 96% of non-teaching staff either strongly agreed or agreed that providers developed a 
positive rapport with faculty and administrative staff. Similarly, although the 2007 evaluation of 
the School Mental Health Program pointed to many successes, it also recommended 
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“programming enhancements, the use of evidence-based practices, and other performance 
improvement options to help maximize clinical and behavioral outcomes” (Noveske, p. 48). 

Quality of school, district and agency data systems and use of data to identify 

strengths and needs, focus resources, monitor progress and evaluate results 

Cleveland has made major strides in developing data systems. These strides include the District 
leadership’s commitment to transparency of information and the development of a new District 
data system; the fact that public systems in Cuyahoga County meet, coordinate and share 
information regularly; a memorandum of agreement on the sharing of data between the District 
and the Cleveland Division of Police; Cuyahoga Tapestry Systems of Care’s decision to use the 
data system that Wraparound Milwaukee developed for quality assurance and improvement; 
Case Western Reserve University’s Northeast Ohio Community and Neighborhood Data for 
Organizing (NEO CANDO) and its adaptation by the Center on Urban Poverty and Community 
Development; and the employment of independent evaluators to evaluate major initiatives. 

Although these strides are impressive, our observations and interviews suggest the need for six 
improvements: (1) Ensuring that data are collected consistently. For example, although the 
District collects deportment grades, which can be used as early warning signs, they are collected 
and reported inconsistently across schools. (2) Ensuring that data are collected regularly on the 
conditions for learning. (3) Defining a parsimonious set of metrics that can be used across the 
school, the community and foundations to monitor needs and assess progress. (4) Expanding the 
use of data systems that monitor individual progress as the Cuyahoga Tapestry System of Care 
has done. (5) Enabling individuals and agencies providing human ware to align their 
interventions with school data for monitoring and evaluation purposes. (6) Enabling the District 
to assess the number and quality of human ware interventions in each school. 

Collaboration, coordination and information sharing in a timely manner 

Cleveland has had many successful collaborations, and its agencies have built on these models 
(e.g., the Annie E. Casey Child Welfare Initiative, the Robert Wood Johnson Mental Health 
Initiative, SYNERGY). This collaboration includes some information sharing between and 
among schools and agencies; collaborations between the District and agencies that include a 
memorandum of agreement bringing services into the schools; the assignment of mental health 
intervention specialists and probation officers to schools; student support staff participation on 
interagency workgroups and committees; and solid collaboration between some community 
agencies and some schools. 

Insufficient service coordination and school-community partnership 

In spite of the aforementioned accomplishments, our interviews consistently pointed to a lack of 
understanding between schools and agencies regarding the constraints and needs of the other 
party; the District and schools taking insufficient advantage of some effective community 
resources (e.g., Cuyahoga Tapestry System of Care, the Positive Education Program); the 
relationship between District administration and the schools being limited by the inability of 
agencies to fully engage schools; a lack of senior-level District participation on interagency 
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workgroups that are planning and implementing communitywide efforts to benefit District 
students; and the inability to engage many principals in mental health efforts. 

These challenges were evident in our case study site visits and interviews. At the high schools 
there is little or no management and coordination of support services for students, and the 
counselors and psychologists are not working well with external supports. They are happy to 
have the services, but they function as a referral system and there is no follow-up or 
collaboration with the school supports. At the elementary school, there is discontent with the 
external social work services. For example, school staff talked about a lack of follow-through on 
recommendations; teachers discussed a lack of system monitoring such as quality control and 
timing of service delivery. 

Numerous key informants including agency representatives reported that agency access to 
schools is contingent on principal interest and leadership, and that these elements are often 
lacking. For example, although the District had identified one of the case study high schools to 
receive the benefits of eight supervised City Year Corp members, there was no evidence of City 
Years presence, apparently because of a lack of interest on the principal’s part, which some 
informants suggest is due to his lack of involvement in the selection of City Year. (City Year 
appears to be working successfully in four of the six schools to which it has been assigned.) 

Recommendations 

Cleveland schools can prevent violence, promote mental wellness and build conditions for 
learning and teaching through the aforementioned three-tiered approach that not only eliminates 
factors placing students at risk of poor outcomes but also builds protective factors and assets that 
help children and youth thrive. The first tier builds a healthy schoolwide foundation that reduces 
the incidence of behavioral and academic problems and enhances the probability of student 
success. The second tier involves intervening early for students who are at elevated levels of 
risk. This intervention should be timely and tied to the identification of known risk factors. The 
third tier involves providing intensive supports and services for students who are at the greatest 
level of need. 

Schools cannot do this work alone. Many Cleveland students, families and educators confront 
daily the impacts of poverty, environmental toxins and trauma. Fortunately, they live, attend 
school and work in a city rich in human and cultural capital and good will. The challenge, 
however, is to harness these resources in a sustained, measurable and strategic manner so that 
every student, every teacher and every school succeeds. Meeting this challenge requires: 

• Building a climate for change and sustaining it over multiple years using data on a small 
number of metrics to refine interventions and enhance the District’s approaches to 
improving student outcomes and well-being; 

• Avoiding single solutions or unaligned multiple solutions for complex, but interrelated 
problems; 

• Eliminating ineffective or counterproductive practices and behaviors; 

• Employing a three-tiered approach to building conditions for and capacities to learn and 
teach; 
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• Aligning promotion and prevention, early intervention and treatment in a manner that 
will both address immediate needs as well as prevent the incidence and magnitude of 
problems; 

• Supporting the ability of schools, agencies and staff to systematically implement proven 
practices and programs with quality; 

• Integrating cultural and linguistic competence as a conceptual framework, operating 
principle and professional skill to guide the educational success of Cleveland’s diverse 
students; 

• Leveraging the District’s and Cleveland’s strengths and resources; 

• Fostering collaboration and coordination between and among schools, agencies, families 
and community organizations; 

• Systematically leveraging public and private resources such as Medicaid, the Cuyahoga 
County Community Mental Health Board, the Cuyahoga Tapestry System of Care and 
the Youth Development Initiative; and 

• Using data for planning, monitoring and evaluation. 

The report’s recommendations address these elements in a sustainable manner that builds on 
Cleveland’s and the District’s strengths to addresses the depth and complexity of needs. The 
recommendations call for changes in the behavior and interactions of all stakeholders - children 
and youth, families, teachers, school and district staff and administrators, agencies and their staff, 
and funders - and, when necessary, propose training and other supports for these changes. The 
recommendations are designed to address individual, school and agency performance and 
capacity. They are also intended to produce short-, middle- and long-term improvements that 
can help Cleveland become a safer and healthier city and the District become the premier 
educational institution that it aspires to be. 

Each set of interventions involves a phase-in process. The interventions and their phasing-in are 
designed to constrict or eliminate the pipelines that create or feed problems (e.g., children 
arriving at kindergarten with emotional and behavioral problems, unmet mental health needs, and 
the lack of positive behavioral approaches and SEL). Significantly, they are intended to reduce 
the level of need so that, over time, there will be less demand for more-intensive services and 
more opportunities to focus resources on learning and healthy youth development. The phase-in 
process has the following logic: 

• Year 1: Address priority 1 needs and low-hanging fruit, improve the infrastructure of 
support, assess, develop protocols and standards, plan, implement where feasible. 

• Year 2: Evaluate and respond to Year 1 results and implement priority 2 
recommendations. 

• Year 3: Evaluate and respond to Year 2 results and implement priority 3 
recommendations. 

• Year 4: Evaluate and respond to Year 2 results and redeploy resources in response to 
changing needs as the level of risk that students display starts to diminish. 
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Implementing these recommendations is both a schoolwide and communitywide responsibility 
and is consistent with the three-tiered public health approach the report describes. For most 
recommendations, we indicate which agency is the lead; in the case of the District, we will 
indicate which office should be responsible for implementing the work. Strategy 1 involves 
recommendations about using data for assessing, planning, monitoring and evaluating the 
conditions for learning, teaching and development and the level of need, risk and wellness of 
Cleveland’s children and youth. The District is responsible here. Recommendations within 
Strategies 2, 3 and 4 focus primarily on universal promotion and prevention. The District has 
the primary responsibility here as well. Recommendations within Strategies 5, 6 and 7 focus 
primarily on early and intensive interventions, and the District and community agencies share 
this responsibility. 

Strategy 8 addresses the need for ongoing and professional development and support, which 
have been identified as necessary in improving outcomes for children and youth with and at risk 
of developing emotional and behavioral problems. Both the District and agencies have 
responsibility here. Strategy 9 addresses the need for focused and sustainable funding to 
support human ware improvements. The District, the city, the county and the foundation 
community share responsibility here. Strategy 10, like the first, involves using data for 
assessing, planning, monitoring and evaluating the conditions for learning, teaching and 
development and the level of need, risk and wellness of Cleveland’s children and youth. 
However, it is placed last because there should be regular monitoring and evaluation of human 
ware activities on a districtwide and communitywide basis. The District, the city, the county and 
the foundation community share this responsibility. 
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Introduction 

This study’s purposes are to examine and identify strengths, challenges and areas for 
improvement related to student mental health and the conditions for learning in the Cleveland 
Metropolitan School District (the District). In its role on the Human Ware Audit, The American 
Institutes for Research (AIR) was asked to provide conclusions about (1) where gaps in student 
connectedness to school, as well as mental wellness and safety, exist and (2) what is needed to 
reach an appropriate and sustainable level of services that will result in the best possible human 
service “safety net” for the District’s students. Our work included analyses of extant data, case 
studies, discussions with key informants and a large number of interviews and focus groups to 
contextualize and validate the case study findings. Our efforts included early stakeholder 
engagement and involvement in the work and input from those who will have to implement the 
changes. One goal has been to maximize the extent to which our findings-based 
recommendations are actionable and will lead to sustainable improvements. 

Eight sets of findings from prior research have guided our Human Ware Audit activities and 
related analyses: 

• Student support, mental health development, safety and academic achievement are 
inextricably linked (Becker & Luthar, 2002; Cambourne, 2002; Greenberg, Skidmore, 
& Rhodes, 2004; Spier, Cai, Kendziora, & Osher, 2007). 

• Effective student support provides connection to caring adults, positive behavioral 
supports, SEL and access to mental health support in a manner that not only addresses 
risk factors but also builds protective factors and developmental assets (McNeely & 
Falci, 2004; McNeely, Nonnemaker, & Blum, 2002; Osher, 2006; Smith, Perry, & 
Smylie, 1999; Wright & Fitzpatrick, 2006). 

• When these supports sufficiently meet the needs of students, they build conditions for 
learning and teaching such that students and faculty feel they are in a safe, 
responsible, supportive and challenging learning environment (Committee on 
Increasing High School Students’ Engagement and Motivation to Learn, & National 
Research Council, 2004; Osher et al, 2007). 

• When these supports are insufficient, the unmet mental health needs of students 
overwhelm the capacity of schools in a manner that undercuts learning and teaching. 
This contributes to reactive and punitive approaches that further undercut the 
conditions for learning and teaching (Osher, VanAker, Morrison, Gable, Dwyer, & Quinn, 
2004; Sebring, Allensworth, Bryk, Easton, & Luppescu, 2006). 

• Effectively providing student support requires a data-informed approach to screening, 
referral and intervention that is systematic and supported by focused professional 
development and the appropriate deployment of pupil service personnel (Blechman, 
Fishman, Fishman, & Lewis, 2004; Metzler, Biglan, Rusby, & Sprague, 2001). 

• Addressing the mental health needs of students and preventing anti-social behavior 
require school-agency and school-family collaboration, both of which are challenging 
to realize (Osher, 2002; Osher & Osher, 2002; Rappaport et al., 2002). 
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• Progress in addressing the mental health needs of students and preventing anti-social 
behavior in Cleveland will more likely occur by effectively implementing culturally 
and linguistically competent programs and strategies that research demonstrates have 
been efficacious in settings like Cleveland (Osher, Dwyer, & Jackson, 2004). 

• Addressing the mental health needs of students and preventing anti-social behavior 
can benefit from a public health approach that (a) intervenes early to minimize the 
likelihood that students will arrive in kindergarten at risk for academic and social 
problems and (b) combines promotion with prevention, early intervention and 
treatment (Hawkins, Catalano, Kosterman, Abbott, & Hill, 1999; Hawkins, Van Horn, & 
Arthur, 2004; Osher, Dwyer, & Jimerson, 2006). 

Organization of the Report 

The report is organized into three sections, a glossary and five appendices. The first section 
describes the methodology employed to examine the quality and adequacy of human services 
and the conditions for learning in the District. The second section describes our findings 
regarding strengths and needs. It is organized around three core constructs: the conditions for 
learning; individual, school and community capacity; and collaboration. The third section 
presents 10 strategies with sets of recommendations to address these findings in a sustainable 
manner, building on Cleveland’s and the District’s strengths to meet the depth and complexity of 
student needs. A glossary of acronyms used in the report is located prior to the appendices, 
which provide a copy of the Conditions for Learning survey (Appendix A); supporting and 
supplementary information including case study school snapshots (Appendix B); a table showing 
mental health agencies and neighborhood collaboratives associated with schools (Appendix C); 
other data tables and figures (Appendix D); and tables displaying, by strategy, the relationship 
between recommendations and findings, an implementation timeline by year and the proposed 
individuals, organizations or entities responsible for implementation (Appendix E). 
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